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Abstract. We consider the problem of representing the value of singular stochastic control prob¬ 
lems of linear diffusions as expected suprema. Setting the value accrued from following a standard 
reflection policy equal with the expected value of a unknown function at the running supremum of 
the underlying is shown to result into a functional equation from which the unknown function can 
be explicitly derived. We also consider the stopping problem associated with the considered singular 
stochastic control problem and present a similar representation as an expected supremum in terms 
of characteristics of the control problem. 
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1. Introduction 

Singular stochastic control problems arise quite naturally in economics and finance. Accord¬ 
ingly, a relatively large class of problems utilized in studying the rational management of renewable 
resources, optimal dividend distribution, and optimal capital accumulation can be modeled as sin¬ 
gular stochastic control problems (see, for example, lllElElttTlEIlEaETllMlEailolllS]; for an 
extensive list of references and applications in economics, see the seminal textbook [22]). Given 
this interest, various techniques for solving singular stochastic control problems have been devel¬ 
oped. Especially in the case where the underlying constitutes an Ito-diffusion process variational 
inequalities have proven to be a very useful tool for characterizing the optimal policy and its value 
(H H HSl Ea ED). The advantage of that approach is that it naturally permits the utilization 
of stochastic calculus and as such applies in a multidimensional and finite horizon setting as well. 
Alternatively, given the close connection of the value of the optimal policy with the value of an 
associated optimal stopping problem the singular stochastic control problem can alternatively be 
approached by focusing on the associated stopping problem and solving both problems by utiliz¬ 
ing probabilistic techniques and relying directly on pathwise properties of the controlled process 
(cf. [SI El [121 E21 ESI Eni Ell E5|)- More recently, it has become apparent that these problems 
can also be approached by relying directly on the general properties of the running supremum and 
infimum of stochastic processes and utilizing these processes in the representation of the values of 
the considered control problems (cf. [TTl [121 1131 EZl El] ) ■ Roughly speaking, these studies delineate 
a set of general conditions under which a process can be expressed as a functional of the running 
supremum or infimum of another process and utilize this observation in the characterization of the 
values of the considered stochastic control problems. This approach provides a general framework 
for analyzing stochastic control problems since it applies outside the Markovian and infinite horizon 
setting. Interestingly, this approach extends also to other representation problems and it can be 
utilized efficiently in the representation of excessive mappings and potentials as expected suprema 
(cf. |28lE9lEQ]). 

Our objective in this study is to extend the analysis developed in [7] and delineate circumstances 
under which the value of a class of singular stochastic control problems can be represented as an 
expected running supremum of a function depending on the underlying diffusion process. The main 
difference to former studies on the subject (e.g. [II1[I21[I31E71E2]) is the fact that we are able 
to derive, in a linear diffusion setting, both the representing function as well as the value of the 
expected supremum explicitly. These closed form representations allows us to extend our analysis 
to various ways and establish interesting connection between different representations. 

Instead of determining the optimal policy and its value directly, we first consider the value 
of a standard reflection policy at an arbitrary constant boundary. We will introduce the problem 
in exact terms in the next section, but to get a general idea of the chosen approach, consider the 
value of a singular control (a local time push) characterized by downward reflection at an arbitrary 
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constant threshold y: 

r (a(Xf) - (i?,7r)'(Xf)) , 

0 

where denotes the reflected diffusion, denotes the control policy, Tq = inf{t > 0 : < 0} 

denotes the exogenous liquidation date, and {RrTT){x) and a{x) are sufficiently nice functions. The 
principal objective of our study is to explicitly determine the representing function f{x) for which 


Hy{x) = Ej; 


Eo; 


/ 


sup Xt 

\0<t<Tr 


l(y,oo) 


sup Xt 

\0<t<Tr 


Hy{x), 


where ~ Exp(r) is an exponentially distributed random time independent of the underlying 
diffusion X killed at 0 in the absence of interventions (see Theorems 13.21 and 13.3p . Computing the 
left hand side of the equation above by utilizing the explicitly known probability distribution of the 
supremum attained at an exponentially distributed random time and requiring equality of these two 
functional forms then results into an identity from which the unknown representing function can be 
explicitly determined. 

Somewhat surprisingly, and in contrast with representation results of optimal stopping prob¬ 
lems, the representing function / is shown to vanish at an arbitrary reflection boundary y — inde¬ 
pendently of whether the boundary is optimal or not. Hence, the condition resulting to the validity 
of the standard smooth fit principle in an optimal stopping setting is not sufficient in the optimal 
reflection case. We demonstrate that in the singular stochastic control case optimality is attained 
at the threshold where the derivative f' vanishes. As intuitively is clear, this condition is shown 
to coincide with the standard C^-smoothness requirement across the optimal reflection boundary; 
a condition which typically arises in singular stochastic control problems of linear diffusions. 

Given that the derivative of the value of a singular stochastic control problem usually coincides 
with the value of an associated optimal stopping problem, we also analyze the optimal stopping 
problem associated with the marginal value of the optimal reflection policy. Furthermore, we derive 
a similar supremum representation for the associated stopping problem under some circumstances 
as well. We find that the representing functions needed for the representations mentioned above are 
functionally dependent on each other so that the one associated with the stopping problem can be 
seen as multiple of the derivative of the representing function associated with the singular stochastic 
control problem. For the sake of completeness, we also analyze the associated nonlinear optimal 
stopping problem arising in the analysis of Gittins indices and characterize this value in terms of 
the derived functional forms. 

The contents of this study are as follows. In section 2 we formulate the considered singular 
stochastic control problem and characterize the underlying dynamics as well as the key functional 
forms needed later in the analysis. Our main findings on the considered representation problem are 
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then summarized in 3. These findings are then illustrated numerically in an explicitly parameterized 
model in section 4. Finally, section 5 concludes our study. 


2. Singular Stochastic Control Problem 


Our objective is to characterize the value of a relatively broad class of singular stochastic 
control problems as expected suprema of a measurable function satisfying a set of regularity and 
monotonicity conditions stated later in this study. To this end, let (0,P, {.Tt}t> 0 )-^) be a complete 
hltered probability space satisfying the usual conditions and assume that the underlying diffusion 
process evolves on X = (0, b) C according to the dynamics described by the generalized stochastic 
differential equation 

(1) dXf = + a{X^)dWt - dZt, X^ = x€l, 


where the drift coefficient /r : X i—>■ M and the volatility coefficient a : X ^ M_|_ are assumed to be 
continuous and to satisfy the conditions (t{x) > 0 for all x G X and 


rx+e 
J X — e 


1 + 


dy < oo 


for some e > 0 and all x G X. These conditions guarantee the existence of a weak solution for 
the stochastic differential equation ([T|) (cf. [36], pp. 342-353). The control policy Z is assumed 
to satisfy Z & S, where <S denotes the class of non-negative, non-decreasing, right-continuous, 
and {Xt}-adapted processes. In what follows, we will denote by X the diffusion X^, when the 
control policy Z does not directly affect the underlying randomly fluctuating process driving the 
stochasticity of the model. We will also assume throughout this study that the upper boundary b is 
natural for the underlying diffusion X and that the lower boundary is either natural, exit, entrance, 
or regular for X. 

Given these dynamics, our objective is to analyze the singular stochastic control problem 

ro 

(2) P(x) = supEj, / e [Tr(Xg)ds + a(Xg)dZs) , 

Z^S J 0 

where tt : X i—> M is a known function measuring the revenue flow accrued from continuing operation 
and a : X i-A M+ denotes the state dependent marginal return associated with utilizing the control 
policy. We will later impose tighter regularity conditions on these mappings in order to be able to 
characterize the values and their representations as expected suprema explicitly. 

As usually, we denote by 


.1 1 2/ N \ d 

the differential operator representing the infinitesimal generator of the underlying diffusion X. As is 
known from the classical theory on linear diffusions, there are two linearly independent fundamental 
solutions s-iid ^{x) satisfying a set of appropriate boundary conditions based on the boundary 
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behavior of the process X and spanning the set of solutions of the ordinary second order differ¬ 
ential equation {Qru){x) = 0, where Qr = A — r denotes the differential operator associated with 
the diffusion X killed at the constant rate r. Moreover, ip'{x)(p{x) — ip'{x)'il>{x) = BS'{x), where 
B > 0 denotes the constant Wronskian of the fundamental solutions and (for a comprehensive 
characterization of the fundamental solutions, see [16], pp. 18-19) 


S'{x) = exp 



denotes the density of the scale function of X. In what follows, we will denote by ipzix) = il^ix) — 
the increasing fundamental solution associated with the diffusion X killed at the boundary 
z € I. It is clear that (cf. [16], p. 19) 


lim 'ijjz(x) 
ziO 


V'(x) — if 0 is regular for X 

'ip{x) otherwise. 


Given the fundamental solutions characterized above, let u{x) = citplx) + C 2 if{x),ci,C 2 € M be 
an arbitrary twice continuously differentiable r-harmonic function and define for sufficiently smooth 
mappings g : I M. the functional 

X/ N / .U'ix) g'ix) , , 

associated with the representing measure for r-excessive functions (cf. |46j 1. Noticing that if g is 
twice continuously differentiable, then 


{Lug)'{x) = -{Qrg){x)u{x)m' {x) 


implying that 

(3) 


{Lug){z) - {Lug){y) = f {Qrg){t)u{t)m'{t)dt 

J Z 


for any a < z < y < b. Finally, we denote by the class of measurable functions / : X i-)- 1R+ 

satisfying for all x G X the integrability condition 


fro 

E, / e-^ViXs)\ds < oo, 

Jo 

where tq = inf{t > 0 : = 0} denotes the first hitting time to 0. As is known from the literature 

on linear diffusions, the expected cumulative present value of a function / G X);(X), that is. 


rro 


{Rrf){x)=¥., e-^^f{Xs)ds 
Jo 

can be expressed as 

(4) {Rrf){x) = B-^ip{x) [ 4>o{y)f{y)m'{y)dy + [ (piy)f{y)m'{y)dy, 

Jo Jx 
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where m'{x) = 2/{a‘^{x)S'{x)) denotes the density of the speed measure m of X. 

In order to guarantee that the considered singular stochastic control problem ([2|) is well-defined 
we first have to make some assumptions on the key functional forms. We first make the following 
assumptions: 

Assumption 2.1. We assume that throughout this section the following conditions are met: 

(a) vr € Cl{I) and tt G C'^(X), 

(b) a G C^{Z), a{x) attains a unique global maximum at Xa G [0,6) and is non-increasing on 
{xa, b ), and 

(c) A{x)/'il)o{x) = 0, where 

px 

A(x) := / a{z)dz. 

Jo 

Assumption I2.ir ai essentially guarantees that the value accrued from leaving the opportunity 
to use the control policy unutilized is finite. Assumption 12.ll bi. in turn, guarantees that while the 
marginal return associated with the control policy is decreasing as a function of the state (i.e. the 
smaller the reserves get, the higher the price of a remaining unit of stock becomes) its cumulative 
value cannot explode. In this way it creates incentives to maintain the reserves unutilized at least 
at low levels. Finally, assumption EHc) guarantees that even though the cumulative marginal 
returns associated with the instantaneous application of the control policy are increasing, they do 
not explode at a rate which would result into the optimality of a single ’’take the money and run”- 
policy exerted at an arbitrarily high state (i.e. instantaneous depletion of reserves as soon as the 
underlying exceeds a beforehand determined threshold). 

It is at this point worth commenting shortly our assumptions on the function a{x) characterizing 
the marginal return associated with the utilization of the control policy. As we will later establish 
in our paper, the existence and uniqueness of an optimal exercise threshold at which the underlying 
diffusion should be reflected downwards does not, per se, impose monotonicity requirements on a{x). 
Hence, the existence of such a barrier can be established even in cases where a{x) does not satisfy 
Assumption 12.li bb Essentially, Assumption I2.11 bl is needed in order to guarantee that the initial 
optimal policy cannot be of the instantaneous shifting down to the optimal boundary type and that 
it has to be either of a standard instantaneous ’’local time” reflection type (cf. [U]) or a chattering 
down to the optimal threshold-type (cf. [2]). The latter of these policies does not belong into the set 
of admissible policies and, thus, it must be interpreted as a limit of admissible distribution strategies. 
In cases where a{x) is, for example, increasing the potentially optimal policies (at date 0) are either 
of the reflection type or of the immediate shifting down to the optimal boundary-type. The reason 
for this argument is that if a{x) is increasing then we naturally have A(x) — A(y) < a{x){x — y) 
which shows that the gradual distribution of reserves above an fixed potentially optimal boundary 
is suboptimal. Finally, in a general setting where a{x) in not monotonic, the optimal policy can be 
characterized as a combination of chattering and instantaneous shifting. 
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Define the mapping ^ : X i—)■ M measuring the option value of depleting the reserves instanta¬ 
neously instead of leaving the reserves uncontrolled by A{x) = A(x) — {RrT:){x). Let us now consider 
the parameterized family of continuously differentiable functions Fy[x) = {RrTi){x) -|- Hy{x), where 
(cf. [6]) 


(5) 


Hy{x) = < 


A(x) - A(y) + xe[y,b) 


A'{y) 


bo {A 

i’oiy) 


X € (0,y). 


As is known from the literature on singular stochastic control, Fy{x) represents the value accrued 
from following a reflecting strategy at a given exogenous boundary y € X (cf. [IZj). Hence, the 
value Fy{x) constitutes a decomposition where the first cumulative part {Rr'n'){x) measures the 
value of continuing operation with the prevailing stock x while the second part Hy{x) captures the 
excess value which can be accrued by utilizing a local time type control policy at a given exogenous 
boundary y. It is worth emphasizing that the function Hy{x) is also closely related to the value of 
the associated singular stochastic control problem 


( 6 ) 


H{x) = sup Ej 

z&s 


r§ 


e-'^^A'{X^)dZs 


To see that this is indeed the case in the present situation, consider only those admissible policies 
X € iS which maintain the underlying diffusion in an arbitrary bounded set (0, y]. Utilizing in that 
case the generalized Ito-Doblin theorem (Doleans-Dade-Meyer formula) to the function {t, x) i—> 


o— rt 


{RrTT){x) yields (cf. Theorem 32 in |44] : see also Lemma 3.1 in |41j i 


E.t 


{RrTT){X^z) = iRrTT){x) - E^ / e-^^TT{Xf)ds + E; 


rT^ 

./ 

Jo 




>0 


where is a sequence of almost surely finite stopping times converging to Tq as n 
n —>■ oo now yields 


(i?,7r)'(Xf)dZ„ 

oo. Letting 


E, 




e-^^7r{Xf)ds = {Rr7r)ix) + E^ / e-'^^Rrir)'{Xf)dZ, 


for any admissible policy Z S maintaining the underlying diffusion in an arbitrary bounded set 
(0,y]. This shows how the singular stochastic control problems ([2]) and ([6]) are related. 


3. Representation of Values as Expected Suprema 

Let Mt = sup{Vs; s < t A tq} denote the running supremum of V = {Xt‘,t < tq} and assume 
that T ~ exp(r) is an exponentially distributed random time which is independent of the underlying 
diffusion. Our objective is to now consider the following identification problem: 

Problem 3.1. Does there exist a function f{x) = /(x)l[y ^^(x) such that for all x € 1 we would have 
Hy (x) = Ea;[/(M 7 ’)] < OO for all x G X. Under which conditions we have Hy{x) = Ea,[sup{/(Vt); t < 
T}] < oo for all x G X. 
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Our objective is in what follows to characterize the function / explicitly. To this end, we first 
observe that since (cf. p. 26 in |16j l 


[Mt >y\ = 


i’oiy) 


we have 

(7) 


Ex[/(Mr)] = V’o(x) / 

JxVy %[z) 

Thus, identity Hy{x) = Ea;[/(M'r)] holds if 

J x\/ij 


( 8 ) 


-* = 

lx\/y 


= 


A{x)-A{y)+A'{y)^^ 


ipo{x) 


A'{y) 

%iy) 


X E [y, b) 
X E (0,?/). 


It is now a straightforward exercise to show that this identity holds for x > y if the function /(x) 
is chosen according to the identity (cf. Section 3.2 in [12]) 

We have, thus, been able to show the following representation result. 


Theorem 3.2. Assume that f is defined as in ([9|). Then, Hy{x) = Kx[f{MT)l[y^b)i^T)] for all 
X E X. 


According to Theorem 13.21 the excess value which can be accrued by utilizing a local time type 
control policy at a given exogenous boundary y can be expressed as the expected value of a function 
/ at the running maximum attained at an exponentially distributed random date. However, despite 
this identity. Theorem 13.21 does not make statements on the potential optimality of the considered 
control policy nor does it characterize circumstances under which the value Hy[x) could be expressed 
as an expected supremum. It is clear by definition of the function / that in order to represent the 
value as an expected supremum, the function / needs to be nonnegative and nondecreasing. Since 
f{y+) = 0 by definition, we notice that /(x) is nonnegative and nondecreasing provided that 


( 10 ) 


f'{x) 


fL 

dx 


A'{x) 

fi'fix) 


fio{x) > 0 


for all X > y. We can now prove our first main representation theorem related to the singular 
stochastic control problem (l2|). 


Theorem 3.3. Assume that the function A'(x)/i/;q(x) attains a unique global maximum at the 
threshold y* = argmax < A'(x)/V>q(x) > and that A'{x)/fi'fix) is non-increasing on [y*,h). If f is 
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defined as in Q, then 

(11) Hy{x)=E^ [sup{/(Xi)l[j,,b)(Xi);t < T}] 

is r-excessive for X for all y > y* and V{x) = Fy* (x). 

Proof. The assumed monotonicity of A'{x)/fiQ{x) on [y*,b) guarantees that 

d A'ix) 

< 0 

dxi’oix) 

for all X > y*. Condition f{y+) = 0 and inequality (fTOjl now guarantees that / is continuous, non¬ 
negative, and monotonically increasing for all y > y* and, therefore, that Hy{x) = Ea;[sup{/(Xi); t < 
T}] in that case. The r-excessivity of Hy[x) then follows from Proposition 2.1 in [28]. The identity 
V{x) = Fy*(x) follows from Theorem 1 in |2|. □ 

Theorem 13.31 states in terms of the ratio A'(x)/fi’Q{x) a set of sufficient conditions under which 
the value of a standard reflection policy at a given fixed threshold can be expressed as an expected 
supremum. Given that the value represents the expected cumulative returns obtained by following 
a reflection policy, it is clear that the highest value which can be attained by following such a policy 
is the one where the reflection policy is exerted at the threshold maximizing the ratio A'(x)/ iPq{x). 
As was pointed out earlier in our paper, Theorem 13.31 does not impose strong monotonicity require¬ 
ments on the marginal return a(x). As is clear from Theorem 13.31 the validity of the considered 
representation is guaranteed as long as the ratio A'{x)/'iPq{x) attains a unique global maximum 
above which it is non-increasing. 

A set of sufficient condition characterizing circumstances under which the requirements of The¬ 
orem 18.31 are met are now summarized in the following. 

Theorem 3.4. Assume that the function (QrA)(x) satisfies the following conditions: 

(i) there exists a x = argmax{(0r^)(a^)} € I so that {QrA){x) is nondecreasing on (0,x) and 
non-increasing on (x, b) 

(ii) \\m.x]j:){QrA){x) > 0 i/0 is unattainable for X, \mix\.o{QrA){x) > 0 i/0 is attainable for X, 
and \\m.x^b{QrA){x) < —e, where e > 0. 

Then, there exists a unique threshold 

y = argmax ) G (x, xq) 

lV'o(2;) J 

where xq = inf{x > x : {QrA){x) = 0}, satisfying the ordinary first order optimality condition 

^ Jo - {GrA){y*)^^l^^ = 0. 


( 12 ) 
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Especially, if f is defined as in ([9]), then the representation CID is r-excessive for X for all y > y* 
and V{x) = Fy*{x), where 


(13) 

Fy,{x) = {RrTrfix) + ^ 


inf 


S'iXtWy*) 


V’o(Xt Vy*) Jo 


/' 

Jo 


TfQ(s){QrA){s)m'{s)ds]t < T 


Proof. As is well-known from the literature on diffusion processes, the resolvent Rj. and the infini¬ 
tesimal generator A — r are inverse operators (see e.g. III.4 in |45]i. Hence, under our assumptions 
we naturally have A{x) = — {Rr{GrA)) (x). By applying the representation ([3]), we observe that the 
existence and uniqueness of the minimizing threshold y* now follows from the identity 


d A'{x) 
dx ^'(x) 


2S'{x) 

a‘^{x)ipQ{x) 


r [ fio{t){QrA){f)m!{t)dt - {GrA){x) ^°^ 

Jo ‘S''(x) 


in a completely analogous way with the proof of Theorem 2 in [2]. Utilizing this identity now proves 
that 

d A'jx) ^ d {RrjGrA))'{x) ^ ^ 

dx^'^{x) dx ^'(x) 

for all x > y*. Condition f{y+) = 0 and inequality (fTUD now guarantees that / is continuous, nonneg¬ 
ative, and monotonically increasing for all y > y* and, therefore, that Hy{x) = E3;[sup{/(Ai); t < 
T}] in that case. The r-excessivity of Hy{x) then follows from Proposition 2.1 in [28]. Finally, 
applying representation ([3|) to the present problem yields 


A{x) - 


A'{x) S'{x) 


-fi{x) = -- 




77^ / i’o{t){GrA){t)m'{t)dt. 
n X Jo 


Thus, we observe by setting y = y* that 

{GrA){y*) S'{xWy* 


fix) = 


r fi'oixVy 

demonstrating the validity of the proposed representation (fT^ . 


pxVy* 

/ i^oi't)iGrA){t)m'{t)dt 

Jo 


□ 


Theorem El presents a set of easily verifiable sufficient conditions under which the value of 
the considered singular stochastic control problem admits a representation as an expected supre- 
mum. Since this representation is closely associated with the excess value which can be accrued by 
controlling the underlying dynamics, we find that (|13D provides a supremum interpretation of the 
maximal yield accrued from controlling the reserves in an optimal fashion. An interesting corollary 
of Theorem 13.41 is summarized in the following. 


Corollary 3.5. Assume that the conditions of Theorem \3.4\ are satisfied and that the representing 
function f is defined as in Q. Then, /(x) > 0 for all x only if y = y*. 

Proof. Noticing that y* = argmin | A{x) — ^f\ '4’oix) | demonstrates that the alleged result follows 

1 Vq\^) ) 

from dH) . □ 
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According to Corollary 13.51 the representing function / defined in ([9]) can be nonnegative on 
the entire state space X only if the constant boundary y is chosen optimally. Otherwise, the set 
where / is nonpositive is nonempty. This is an interesting observation, since even though the 
representing function / is constructed so as to guarantee that condition /(y) = 0 is always met, it 
is not necessarily nonnegative on X. 

Theorems 13.21 and Ea characterize the auxiliary function / needed for the representation of the 
value as an expected supremum explicitly by deriving hrst the value of the optimal strategy and 
then solving the Volterra equation ([8]). It is, naturally, of interest to ask if the reverse is also true. 
More precisely, can the value and optimal strategy be directly characterized by a given / possessing 
a set of suitable properties? A set of circumstances under which the answer to this question is 
positive are summarized in the following proposition. 

Proposition 3.6. Assume that is convex and let y* := inf{y G X : f{y) > 0}, where / : X i-A M 

is defined by 

f{x) = A'ix) - 

Assume also that f{x) is positive for all x > y*. Then, y* = argmax {A'(y)/-0'(?/)} and the conclu¬ 
sions of Theorem V3.A hold. 


Proof. The identity y* = aT:gm.ax{A'{y)/ip'{y)} follows directly from 


fix) = - 


d [ A'{x) 


dx \'tp'{x) 


i){x) = f{x\ 


fix) 


'0(x). 


Furthermore, since f{x) > 0 on [y* ,b) by assumption, we notice that f'{x) > 0 for all x > y*. The 
alleged claim now follows from Theorem 13.31 □ 


Proposition 13.61 delineates circumstances under which the optimal reflection threshold can be 
identihed as the smallest state at which an associated function / remains positive. As we will see 
in what follows, the function / is related to a stopping problem characterizing the marginal value 
of the optimal policy. 


4. Associated Optimal Stopping Problem 

Having analyzed the representation of the value of the optimal singular policy as an expected 
supremum, we now plan to consider the special case where the marginal value V'{x) of the con¬ 
sidered singular stochastic control problem ([2|) constitutes the solution of an associated stopping 
problem and extend our representation to that setting as well. More precisely, we now consider the 
parameterized family of continuous functions Fy{x) = (RrTrYix) -\- Hy{x), where 

H'yix) = 


(14) 


A'{x) x^[y,h) 
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Before proceeding we establish the following auxiliary result. 


Lemma 4.1. Assume that conditions of Theorem \3.4\ satisfied. In that case the marginal value 
V'{x) = (i?r.7r)'(x) + Hyt{x) of the optimal policy can be expressed as 


(15) 



Moreover, the mapping {Gry){x) + 7r(x) is non-positive and non-increasing on I. 

Proof. The representation (1151) is a direct consequence of the hndings of Theorem 13.41 Moreover, 
since V{x) = Fy*{x) = {Rr7r){x) + Hy*{x) satishes the identity {QrFy*){x) + 7r(x) = {{QrA){x) — 
(C/r^)(y*))l[y*,fe)(ai) for all X G I and {QrA){x) is decreasing on [y*, b), we hnd that {GrV)ix) + vr(x) 


is non-positive and non-increasing on I. 


□ 


Lemma O demonstrates that the marginal value of the optimal singular stochastic control 


policy constitutes the solution of an associated nonlinear programming problem. As we will observe 
later in this study, combining this property with the monotonicity of the mapping (Gry){x) + 'k{x) 


can be utilized in the determination of situations under which the marginal value y'(x) constitutes 


the value of an associated optimal stopping problem. In order to accomplish this task, we hrst 
have to make some extra assumptions on the inhnitesimal characteristics of the underlying process. 
These extra assumptions are listed in the following. 

Assumption 4.2. Assume that the following conditions are met: 

(A) the inhnitesimal drift /i(x) and volatility coefficient (t{x) are continuously differentiable on 


I and 



for some e > 0 and all x G X 


(B) r > pi'{x) for all x € I, that is, the rate at which a unit of account appreciates is decreasing. 


Assumption l4.2l Ai guarantee the existence of a weak solution for the stochastic differential 
equation (cf. [36]) PP- 342-353) 

(16) 



It is clear that the density of the scale of X is related to the density of the scale of X through the 
identity S'{x) = S'(x)/(x). The density of the speed measure of X reads, in turn, as rh'{x) = 
2/S'{x). 


Given the process X characterized by the stochastic differential equation (|16p and the marginal 
value (fT^ of the optimal policy, we now consider the optimal stopping problem 


(17) 


G(x) = (i?^7r)'(x)-k supEj, e -^o °> 


r 
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where tq = inf{t > 0 : Xj = 0} and p{x) = r — p!{x). Given that the marginal expected cumulative 
present value {Rr7ry{x) is independent of the stopping strategy, we can naturally focus on the 
stopping problem 


(18) 


F(x) = supE, 


and compare it with the marginal value of ([6]). 

We immediately obtain the following useful result. 


Lemma 4.3. Assume that the conditions of Theorem \3.4\ dnd Assumptions \4-^ are satisfied. Then, 
x) = Hy*(x) > H{x) for all x € X. Moreover, if 0 is unattainable for X, if'{x) = —oo 

and {x) = oo, then H'{x) = Hyt.{x) = H{x) and t* = inf{f > 0 : W > V*} is an optimal 

stopping time. 


Proof. We notice that Theorem 18.31 guarantees that H{x) = Hy*{x). Utilizing this identity and the 
known properties of the value Hy*{x) hrst implies that Hy*{x) > A'{x) for all x €l. Second, since 
Hy. (x) satishes the identity {QrHy*){x) = 0 for all x G {0,y*), we find by ordinary differentiation 
{QrHy*)'{x) = 0 for all x € (0,i/*). Third, since {QrHy*){x) = {QrA){x) + r (^A{y*) - A'(y*)^^^'^ 
for all X G [y*,b), we find by ordinary differentiation {x) = {QrAy{x) < 0 for all x G {y*, b). 

Consequently, we observe that [QrHy*)'{x) < 0 for all x G X \ {y*} and \Hy*{y*±)\ < oo. Since 

{QrHy*y{x) = io-^(x)i4"f (x) + (y(x) + a{x)a'{x))H'yfix) - p{x)Hy*{x) 
we find by applying the Ito-Doblin theorem to the function Hy^, (x) that 


Hy:, (x) = 


> E,, 


Jo 


e-fy"p(^s)dsxfix^j 


where is a sequence of almost surely finite stopping times converging to an arbitrary stopping 
time T A To as n t oo- Invoking monotone convergence now implies that 




Since this inequality is valid for any stopping time, it has to be valid for the optimal one from which 
the alleged inequality follows. 

In order to prove the second part of our lemma, it is sufficient to show that the value Hy* (x) 
can be attained by following an admissible stopping time. To see that this is indeed the case, we 
notice since fi'{x) and ip'{x) satisfy the ordinary differential equation 

^cj^(x)u"(x) + (y(x) + a{x)a' {x))v' {x) — p{x)v{x) = 0 


(19) 
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and if"{x)'tp'(x) — cp'{x)'ijj''(x) = 2rBS'{x) / 0 all solutions of (fT^ have to be of the form v{x) = 
ci'il)'{x) + C 2 pi'{x). On the other hand, as was shown in Lemma 3.3 and Lemma 3.4 of [3], As¬ 
sumption |421^B) and the assumed boundary behavior of the underlying diffusion guarantee that the 
fundamental solutions 'ijj{x) and ip{x) are strictly convex on I. Hence, we find that for all x G iz,y) 




o-Jo pi^s)ds 


Vl{x) V 2 {x) 
Vi{z) V 2 {y)' 


where f = inf{t >0:Xt^ denotes the hrst exit time of X from (z,y), vi(x) = ^/(y) i^'ix) — 

p'{x) is the decreasing and V 2 {x) = — ‘p'ix) the increasing fundamental solutions of (fT9l) for 

X killed at the boundaries z, y. The assumed boundary behavior implies that limj,|o i’'(z) f <p'(z) = 0 
and {y)/fp'(y) = 0. Hence, we notice by invoking the condition \im.ziap'{z) = —oo that 


lim E,r 


o-So p{Sis)ds 




In a completely analogous fashion, we observe that 

limE^ 

y^b I 


(p'{z)' 


Consequently, we notice that ^p'{x) constitutes the increasing and —(p'{x) the decreasing fundamental 
solutions of (uni) for X killed at the rate r — y'{x) and, therefore, we have 


HL (x) = E,i 




where fy* = inf{f > 0 : > y*}. 


□ 


Lemma 14.31 demonstrates that the marginal value of the optimal singular policy dominates the 
value of the associated stopping problem. Lemma 14.31 also characterizes in terms of the boundary 
behavior of the underlying diffusion and the limiting behavior of the derivatives of the fundamental 
solutions circumstances under which the the marginal value of the optimal singular policy coincides 
with the value of the associated stopping problem. It is worth noticing that the verification of these 
conditions is a relatively straightforward task in the cases where b = oo and the drift and volatility 
coefficients admit the series representation fi{x)x/a‘^{x) = Yl’^=o^kX^ and x^ja^ix) = 
since in that case the solutions of {Gru){x) = 0 take the form (a Frobenius series representation, cf. 
@8] pp. 364-370) 

OO OO 

u{x) = C'lX^+ ^ CkX^ + C 2 x'^~ ^ CkX^ 

k=0 k=0 




Ao ) + 2r6Q 


where 
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and 


V- = 


1 

2 


— Ao 



Ao ) + 2r(5o 


constitute the roots of the indicial equation r]{rj — 1) + 2Ao?/ — = 0. It is clear that if vSq > Aq, 

then r/_|_ > 1 and, consequently, x^+ is increasing, strictly convex, and satisfies the limiting condition 
^ oo as X ^ oo. 

Given our observations on the marginal value, we now ask under the conditions of Lemma 14.31 
the following question: 


Problem 4.4. Is there a nondecreasing representing function / : X ' 


for which 


( 20 ) 


E, 


sup{f{Xt)'^ly*^b){Xt)-,t < fp} = H{x) = Hy*{x), 


where Tp denotes the life time of the process Xt killed at the rate r — p'{x). 


In light of the results of Lemma [4.3l it is clear that if (12011 holds, then we would necessarily have 

Lvy* ^ 

Applying ([5]) for x > y* then results into the identity 

V^'(x)^ = A'(x). 

from which we obtain by straightforward differentiation that (cf. [7]) 

/(x) = A!{x) - 

To derive an alternative expression for the representing function / in terms of the representing 
function /, we notice by invoking dZD that 



Consequently, the functions / and / are related with each other through the identity 



For X € [y*, b) we have that 



Standard differentiation then yields 


2r1'(r\ 

/(^) = 21 1 I 1 / miiQrA){t)-{grA){x))m'{t)dt 
a [xjip (^xj Jo 


2S'ix) r if'{t) 
cr2(x)V’"(x) Jo S'{t) 


{grA)'{t)dt. 
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Given this expression, we are now in position to establish the following representation result (cf. 
Proposition 2.13 in [20] and Theorem 3.7 in m)- 


Theorem 4.5. Assume that the conditions of Theorem \3.4\ dnd Assumptions 14-31 are satisfied. 
Assume also that 0 is unattainable for X and X killed at the rate p{x) and that the function 
{QrA)'{x)/p{x) is non-increasing on I. Then 


( 21 ) 


/(,) = A'(,) - 


p{t)'ijj'{t)m'{t)dt 

is nondreasing on [y*,b) and satisfies the condition f{y*) = 0. Moreover, 

'Ip' {t){QrA)' {t)rh'{t)dt 


( 22 ) 


77((r) = 77' (x) = E, 


sup 


p{t)p'{t)rh'{t)dt 




Proof. We first observe that p{x) has nice second order properties in the sense that 

d 


dx 


2 ^ ^5'(x) 


, .'p'ix) 

= "WslU > “ 


for all X G X. Since p'{x) constitutes the increasing fundamental solution of (IlOp for X killed at 
the rate p{x), we notice that the assumed boundary behavior guarantees that p"{x)/S'{x) ^ 0 as 
X 0. Hence 

1 2 / \'P"{^) /"^ / \ 'P'{P) 1 

2'^ = f ’ 

which proves that / has the alleged form (1211) under the assumptions of our theorem. It is now 
sufficient to prove that / is nondecreasing. To see that this is indeed the case, we notice by ordinary 
differentiation that 

p{x)p'{x)m'(x) ( /.N ,//,N A^r^)'(7) {GrAYix)' 


fix) = 


(/o' pit)P'{t)rh'{t)df) \Jo 


pit)p'{t) 


pit) 


pix) 


m'{t)dt I > 0 


since {GrAy{x)/p{x) was assumed to be non-increasing. Hence, / is nondecreasing on I. Finally, 
representation (12211 follows from (I20p . □ 


It is worth noticing that our results actually prove that 


fix) = fix) 


fix) 

p'{x)‘^ 


fi{x) 


~ d\iip'{x) 


Hence, applying Proposition 13.61 shows that / does not only dictate the behavior of the value of 
the stopping problem (cf. Theorem 3.7 in [3), it also determines the behavior of the value of the 
singular control problem. 

Under specific circumstances our results are also directly related with the optimal signal results 
related to Gittins indices (cf. [TOl |26l |3l])- In [ID] it was shown that the stopping set of an 
optimal stopping problem equals to a set where the so called optimal stopping signal 7 : X ^ R 
associated with the particular stopping problem is non-negative. This has been further connected 
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to our representation in [3 Proposition 2.14], where it was proved that the representing function 
f{x) actually coincides with ^{x) on the stopping set of an associated nonstandard optimal stopping 
problem. 

To see how our present representation is related to the optimal stopping signal, we first denote 
as T the set of first exit times inf{t > 0 : Xt 0 {z,y)} from open intervals {z,y) C I with compact 
closure in Z. Our main finding on the connection between the developed approach and optimal 
signals is summarized in the following. 


Theorem 4.6. Assume that the conditions of Theorem d.f and Assumptions are satisfied. 
Assume also that 0 is unattainable for X and X killed at the rate p{x) and that the flow tt{x) is 
monotonieally inereasing on Z. Then x > y* if and only if f{x) > 1, where 


lix) = inf 

tGT • 


Ex 

a(x) -e-io>(W)rf^a(X^) 


Ex 

{RrTT)fix) — e Jo P(^‘’^‘^^(Rr7r)' 



If the flow 7r{x) is monotonieally deereasing on Z, then x > y* if and only if f{x) < 1, where 




fi{x) = sup — 
tGT E, 


a(x} - e- fo ) 


(Rr7ry(x) - e-fo f’(^^)^^(Rr7ry(Xf ) 


Proof. We first notice that the assumed monotonicity of the flow tt{x) implies that the expected cu¬ 
mulative present value {RrTT){x) is monotonieally increasing as well and, therefore, that (Rrirfix) > 
0 for all x & Z. On the other hand, since {RriT){x) satisfies the ordinary differential equation 
(QrRr7r){x) -|-7r(a:) = 0 and tt{x) was assumed to be continuously differentiable, we notice by differ¬ 
entiating that 

-a'^{x){Rr7r)"'(x) + {p{x) + (T{x)a'{x)){RrTT)"{x) — p{x){RrT^y{x) = — 7 r'(x) < 0 
for all X G T. Consequently, if f G T, then 


E.r 


e-/o" p(^-)^^{FfiTTy{X^)] = (Rr-TTfix) [ e"^0 < (i2^7r)'(x) 

Jo 


for all X £Z. 

It is clear that under the conditions of our theorem Hy* (x) constitutes the smallest excessive 
majorant of the exercise payoff A'{x) = a{x) — {Rr'xy{x) for the diffusion Xt killed at the rate p{x). 
However, a nonnegative and measurable function I :Z ^ M_|_ U {oo} is excessive for the diffusion Xt 
killed at the rate p{x) if, and only if, fix) is continuous and satisfies for all x G T the inequality 


Ex 




< fix), 


where f G T is an arbitrary first exit time from an arbitrary open set with compact closure in 
Z (cf. [23], Theorem 12.4. on pp. 7-8). Consequently, we find that x G {x G X : Hy,(x) = 
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a{x) — {RrirYix)} = [y*,b) if, and only if 


Ex - (i?rVr)'(Xf))l < a{x) - {RrTT)'{x) 


for all f G T. Reordering terms then yields that we have 


\a{x) - e-fo 


Ex [(Rrvr)'(a:) - e-fo 


> 1 


for all T &T. On the other hand, if x € {x G X : Hy»{x) > a{x) — (Rx7r)^(x)} = {a,y*), then 


Ex e-ff - (Rxvr)'(lf*)) > a(x) - (Rxvr)'(x) 


where f* = inf{f > 0 : X* > y*} denotes the optimal exercise time. Hence, we find that [y*,b) = 


{x G X : 7 (x) > 1} as claimed. Establishing the signal interpretation in the monotonically decreasing 


setting is completely analogous. 


□ 


5. Explicit Example 


Our objective is now to illustrate the considered class of singular stochastic control problems 
and the possible intricacies associated with the developed representation results in an explicitly 
parameterized example. To this end, we assume that the underlying dynamics evolve in the absence 
of interventions according to a standard GBM characterized by the stochastic differential equation 
© with a drift fi{x) = jlx and a volatility coefficient (t(x) = ax, where d > 0. We also assume 
that 7r(x) = x^ and a(x) = + K2{1 — where rj G (0,1), Ki > K 2 > 0, and u > 0 are 

exogenously determined constants. 

It is well-known from the literature that in this case the fundamental solutions read as 'ip{x) = x'^ 
and (p{x) = x^, where 



and 



Moreover, {RrTT){x) = Mx^, where 


( 23 ) 


r — firj — fa‘^'q{r] — 1) 


Utilizing these findings show that if a > 1 (i.e. if r > /2), then 



i/^'(x) 
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and A'(x)/Ip'{x) attains a global maximum at a uniquely defined threshold 

satisfying the ordinary first order condition 

Alrj{K — — {Ki — K 2 )e~'^^ (k — 1 + vy*) — v{Ki — K 2 )e~'^^ = 0. 


In this case, the value of the optimal policy reads as 


V{x) 


- e-^^) + K 2 {x - y*) + My*'^ + ^^y* 

MxV + 


x>y* 

- jk 

X <y 


and the function needed for the representation as an expected supremum reads as in ([9]) with 


A{x) - 


A'{x) 

ip'{x) 


ip{x) = 


{k — 1)K2X k — rj 


Mx'^ + {Ki - K2) 


1 — e 


The representing functions / associated with three different thresholds (the optimal one as well as 
two suboptimal) are illustrated in Figure [1] in the case where a = 0.1, r = 0.05,// = 0.01, Ki = 
12,il'2 = 10, u = 0.1, and r/ = 0.5. As is clear from Figure [U choosing the threshold y* optimally 
results into a representing function which is nonnegative on the entire state space. As soon as 
the threshold is chosen in a suboptimal fashion, the representing function can attain also negative 
values. 


fix) 



Figure 1. The representing function /. 


We also notice that if k > 1 then 


H{x) = H'y.{x) 


Kie + (1 — e '^''^)K 2 — rjMx'^ ^ x > y* 

+ (1 - e-''y*)K2 - yMy*^-^) 


X <y 
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and 

fi^) = ——r ((-^1 “ K 2 )e~'''^{vx + k-1) - {k- r])r]Mx'^~^ + K 2 {k - 1)) . 

tv - 1 


6. Conclusions 

We considered a class of singular stochastic control problems admitting the representation of 
both the value of the optimal policy as well as its marginal value as an expected supremum. Instead 
of determining the optimal policy and its value at once, we first stated the expected cumulative 
present value of the revenue flow accrued by following an ordinary reflection policy at an arbitrary 
constant boundary. We then computed the expected value of an unknown function depending on 
the running supremum attained at an exponentially distributed random time by utilizing the known 
probability distribution of the running supremum. Setting these values equal to each other then 
results into a functional equation from which the unknown function is then determined. 

In contrast with optimal stopping problems, the function needed for the representation vanishes 
at the reflection boundary independently of wether it is optimal or not. As our results indicate, 
optimality is attained at the threshold where the derivative of the above mentioned function vanishes. 
This condition is shown to coincide with the standard C^-smoothness condition arising in singular 
stochastic control problems. Interestingly, since the marginal value of the singular stochastic control 
problem constitutes under some circumstances the value of an associated stopping problem, a similar 
supremum representation was shown to hold for the marginal value as well. Since the functions 
needed for the representations depend on each other, it is precisely this connection which explains 
the different regularity conditions needed for the characterization of the optimal boundary. 

This study focused on a single boundary setting where the reflection policy is exerted only at 
a single optimal state resulting into a maximized expected cumulative yield. Even though this is 
sufficient from the perspective of many financial and economic applications of singular stochastic 
control theory, it would be mathematically interesting to try to investigate if a similar representation 
as an expected running supremum could be determined in a case where the underlying can be 
controlled both upwards as well as downwards within the considered reflecting policy setting (cf. 
m and [H]). It is clear in light of previous results on two-boundary optimal stopping problems 
that such a problem formulation typically result into the analysis of quite demanding nontrivial 
integral equations. A second natural direction towards which our approach could be developed is 
impulse control (cf. [19ji. Since optimal reflection can be typically seen as a limiting policy arising 
as the fixed costs associated with the implementation of an impulse policy tend to zero, it would be 
of interest to see how this limiting behavior arises within an expected supremum setting. Especially, 
it would be of interest to see how the extreme sensitivity of the value with respect to small changes 
in costs (cf. [33]) affect the representation. Both these extensions are out of the scope of the present 
study and left for the future. 



20 


LUIS H. R. ALVAREZ E. AND PEKKA MATOMAKI 


References 

1. M. Akian, J. L. Menaldi, and A. Sulem, On an investment-consumption model with transaction costs, SIAM J. 
Control Optim. 34 (1996), no. 1, 329-364. 

2. L. H. R. Alvarez E., Singular stochastic control in the presence of a state-dependent yield structure, Stochastic 
Process. Appl. 86 (2000), no. 2, 323-343. 

3. _, A class of solvable stopping games, Appl. Math. Optim. 58 (2008), no. 3, 291-314. 

4. _, Optimal capital accumulation underprice uncertainty and costly reversibility, J. Econom. Dynam. Control 

35 (2011), no. 10, 1769-1788. 

5. L. H. R. Alvarez E. and L. A. Shepp, Optimal harvesting of stochastically fluctuating populations, J. Math. Biol. 
37 (1998), no. 2, 155-177. 

6. L. H. R. Alvarez E. and J. Virtanen, A class of solvable stochastic dividend optimization problems: on the general 
impact of flexibility on valuation, Econom. Theory 28 (2006), no. 2, 373-398. 

7. L.H.R. Alvarez E. and P. Matomaki, Expected supremum representation and optimal stopping, arXiv: 1505.01660 
(2015). 

8. F. M. Baldursson, Singular stochastic control and optimal stopping. Stochastics 21 (1987), no. 1, 1-40. 

9. F. M. Baldursson and I. Karatzas, Irreversible investment and industry eguilibrium, Financ. Stoch. 1 (1997), 69 - 
89. 

10. P. Bank and C. Baumgarten, Parameter-dependent optimal stopping problems for one-dimensional diffusions, 
Electron. J. Probab. 15 (2010), 1971-1993. 

11. P. Bank and N. El Karoui, A stochastic representation theorem with applications to optimization and obstacle 
problems, Ann. Probab. 32 (2004), 1030-1067. 

12. P. Bank and H. Follmer, American options, multi-armed bandits, and optimal consumption plans: a unifying view, 
Paris-Princeton Lectures on Mathematical Finance, 2002, Lecture Notes in Math., vol. 1814, Springer, Berlin, 
2003, pp. 1-42. 

13. P. Bank and F. Riedel, Optimal consumption choice with intertemporal substitution, Ann. Appl. Probab. 11 (2001), 
750-788. 

14. V. E. Benes, L. A. Shepp, and H. S. Witsenhausen, Some solvable stochastic control problems. Stochastics 4 
(1980/81), no. 1, 39-83. 

15. F. Boetius and M. Kohlmann, Connections between optimal stopping and singular stochastic control. Stochastic 
Process. Appl. 77 (1998), no. 2, 253-281. 

16. A. Borodin and P. Salminen, Handbook of brownian motion - facts and formulae, Birkhauser, Basel, 2002. 

17. A. Cadenillas, S. Sarkar, and F. Zapatero, Optimal dividend policy with mean-reverting cash reservoir. Math. 
Finance 17 (2007), no. 1, 81-109. 

18. P. L. Chow, J. L. Menaldi, and M. Robin, Additive control of stochastic linear systems with finite horizon, SIAM 
J. Control Optim. 23 (1985), no. 6, 858-899. 

19. S. Christensen and P. Salminen, Impulse control and expected suprema, arXiv: 1503.01253 (2015). 

20. S. Christensen, P. Salminen, and B. Q. Ta, Optimal stopping of strong markov processes. Stochastic Process. Appl. 
123 (2013), 1138-1159. 

21. T. De Angelis, G. Ferrari, and J. Moriarty, A Nonconvex Singular Stochastic Control Problem and its Related 
Optimal Stopping Boundaries, SIAM J. Control Optim. 53 (2015), no. 3, 1199-1223. 

22. A. K. Dixit and R. S. Pindyck, Investment under uncertainty, Princeton University Press, New Jersey, 1994. 

23. E. B. Dynkin, Markov processes: volume ii. Academic Press Inc., Publishers, New York; Springer-Verlag, Berlin- 
Gottingen-Heidelberg, 1965. 



EXPECTED SUPREMUM AND SINGULAR STOCHASTIC CONTROL 


21 


24. N. El Karoui and H. Follmer, A non-linear riesz respresentation in probabilistic potential theory, Ann. Inst. H. 
Poincare Probab. Statist. 41 (2005), 269-283. 

25. N. El Karoui and I. Karatzas, A new approach to the Skorohod problem, and its applications, Stochastics Stochastics 
Rep. 34 (1991), no. 1-2, 57-82. 

26. _, Dynamic allocation problems in continuous time, Ann. Appl. Probab. 4 (1994), no. 2, 255-286. 

27. N. El Karoui and A. Meziou, Max-plus decomposition of supermartingales and convex order, application to amer- 
ican options and portfolio insurance, Ann. Probab. 36 (2008), 647-697. 

28. H. Follmer and T. Knispel, A representation of excessive functions as expected suprema, Probab. Math. Statist. 
26 (2006), 379-394. 

29. _, Potentials of a markov process are expected suprema, ESAIM: Probabability and Statistics 11 (2007), 

89-101. 

30. U. G. Haussmann and W. Suo, Singular optimal stochastic controls I: Existence, SIAM J. Control Optim. 33 
(1995), no. 3, 916-936. 

31. _, Singular optimal stochastic controls II: Dynamic programming, SIAM J. Control Optim. 33 (1995), no. 3, 

937-959. 

32. M. Jeanblanc-Picque and A. N. Shiryaev, Optimization of the flow of dividends, Russian Math. Surveys 50 (1995), 
257 - 277. 

33. I. Karatzas, A class of singular stochastic control problems, Adv. in Appl. Probab. 15 (1983), no. 2, 225-254. 

34. _, Gittins indices in the dynamic allocation problem for diffusion processes, Ann. Probab. 12 (1984), no. 1, 

173-192. 

35. I. Karatzas and S. E. Shreve, Connections between optimal stopping and singular stochastic control I. Monotone 
follower problems, SIAM J. Control Optim. 22 (1984), no. 6, 856-877. 

36. I. Karatzas and S. E. Shreve, Brownian motion and stochastic calculus. Springer-Verlag New York, 1988. 

37. T. 0. Kobila, A class of solvable stochastic investment problems involving singular controls. Stochastics Stochastics 
Rep. 43 (1993), no. 1-2, 29-63. 

38. R. Lande, Engen S., and Smther B.-E., Optimal harvesting, economic discounting and extinction risk infiuctuating 
populations, Nature 372 (1994), 88 - 90. 

39. _, Optimal harvesting of fluctuating populations with a risk of extinction, Am. Nat. 145 (1995), 728 - 745. 

40. E. M. Lungu and B. Oksendal, Optimal harvesting from a population in a stochastie crowded environment, Math. 
Biosci 145 (1997), no. 1, 47-75. 

41. P. Matomaki, On solvability of a two-sided singular eontrol problem. Math. Methods Oper. Res. 76 (2012), no. 3, 
239-271. 

42. A. Oksendal, Irreversible investment problems, Financ. Stoch. 4 (2000), 223-250. 

43. B. Oksendal, Stoehastic control problems where small intervention easts have big effects, Appl. Math. Optim. 40 
(1999), no. 3, 355-375. 

44. Philip E. Protter, Stochastic integration and differential equations. Stochastic Modelling and Applied Probability, 
vol. 21, Springer-Verlag, Berlin, 2005, Second edition. Version 2.1, Corrected third printing. 

45. L. C. G. Rogers and D. Williams, Diffusions, Markov processes, and martingales. Vol. 1, Cambridge Mathematical 
Library, Cambridge University Press, Cambridge, 2000, Foundations, Reprint of the second (1994) edition. 

46. P. Salminen, Optimal stopping of one-dimensional diffusions. Math. Nachr. 124 (1985), 85-101. 

47. S.E. Shreve, J.P. Lehoczky, and D.P. Gaver, Optimal consumption for general diffusion with absorbing and reflect¬ 
ing barriers, SIAM J. Control Optim. 22 (1984), 55-75. 

48. D. Zwillinger, Handbook of differential equations, third ed., Academic Press, Inc., Boston, MA, 1997. 



